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DETAILED ACTION 
Drawings 

The informal drawings are not of sufficient quality to permit examination. The 
drawings have "blacked out" regions and thus indistinct areas as observed in Figures 
4A, 4B, 4C. 4D. 4E, 7C, 7D, 8B. 

Accordingly, replacement drawings sheets in compliance with 37 CFR 1.121(d) 
are required in reply to this Office action. The replacement sheet(s) should be labeled 
"Replacement Sheet" in the page head (as per 37 CFR 1.8 (c)) so as not to obstruct any 
portion of the drawing figures. If the examiner does not accept the changes, the 
applicant will be notified and informed of any required corrective action in the next Office 
action. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1-2 and 9-10 are rejected under 35 U.S.C. 103(a) as being unpatentable 

over Sloan ("Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, 

Low-Frequency Lighting Environments") in view of Heidrich ("Illuminating Micro 

Geometry Based on Precomputed Visibility"). 
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In regard to claim 1, Sloan teaches a computer graphics image rendering 
method, comprising of calculating data of macro-scale radiance transfer coarsely 
sampled over a surface of an object by showing a novel global transport simulator 
creates functions over the object's surface representing transfer of arbitrary, low- 
frequency incident lighting into transferred radiance which includes global effects like 
shadows and interreflections from the object onto itself. (Abstract, lines 4-8) However, 
Sloan fails to explicitly teach calculating data of meso-scale radiance transfer finely 
sampled over a meso-structure texture patch mapped over a surface of the object. 
However, this is what Heidrich teaches. Heidrich teaches an inexpensive method for 
consistently illuminating height fields and bump maps, as well as simulating BRDFs 
based on precomputed visibility information, with this information we can achieve a 
consistent illumination across the levels of detail. (Abstract, lines 10-15) Although 
Sloan does not explicitly teach evaluating radiance transfer over at least a portion of the 
surface of the object from a lighting environment for a view direction based on a 
combination of the macro-scale radiance transfer data and the meso-scale radiance 
transfer data and producing an image of the object as lit according to the radiance 
transfer evaluation, it would have been obvious to one of ordinary skill in the art at the 
time the present invention was made to combine the teachings of calculating data of 
meso-scale radiance transfer sampled over a texture patched mapped over a surface 
as taught by Heidrich into calculating data of macro scale radiance transfer sampled 
over a surface taught by Sloan because the computation of meso-scale radiance 
transfer as taught by Heidrich allows for reduced scattering in the case where curved 
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base geometry causes the valleys to widen up, and at the same time, more regions are 
shadowed (Lower left column of p. 462 and Fig. 11) and allows the use of geomeitry, 
bump maps, and BRDFs as difl'erent levels of detail for a surface structure (Right 
column of p. 462) and therefore a more accurate 3-D model would be realized. 

Regarding Claim 2, Heidrich teaches a computer graphics rendering method 
wherein meso-scale radiance transfer data is the height field by explaining the algorithm 
is based on precomputation and reuse of visibility information in height fields, simulates 
both shadowing and indirect illumination, and is able to approximate the illumination as 
underlying base geometry changes. (Lower right column, p. 455) Heidrich further 
teaches an algorithm that computes illumination at a given surface point, but ignores 
indirect light from geometry other than the height field. (Lower left column, p. 457) 
Since claim 2 further limits claim 1 by providing the specific type of data used in meso- 
scale radiance transfer, the motivation and combination are incorporated by reference in 
the parent rejection. 

In regard to claim 9, Sloan teaches a computer-readable data carrying media 
having encoded thereon computer executable instructions for performing a computer 
graphics image rendering method by explaining graphics hardware useful to capture 
radiance samples in a dynamic scene and precision issues and inability to do inner 
products in hardware force us to read back the sampled radiance images and project 
them in software. (Right column, p. 532); said calculating data of macro-scale radiance 
transfer sampled over a surface of an object by explaining for efficiency, we precompute 
textures for the basis functions weighted by differential solid angle, B1(s) =y1(s)ds(s) 
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each evaluated over the cube map parameterization for s. The resulting integral then 
becomes a simple dot product of the captured samples of the incident radiance { Lp(s) } 
with the textures B1(s). Ideally, this computation would be performed on the graphics 
hardware. (Right column, p. 532) Sloan also teaches producing an image of the object 
as lit according to the radiance transfer evaluation by showing analysis shows that, 
assuming continuous bilinear reconstruction over the sampled 2D images, projection to 
6-th order using 6x8x8 images yields 0.7% and 2% average and worst-case squared 
error, while 6x16x16 yields 0.2% and 0.5% squared error, and 6x32x32 yields 0.05% 
and 0.1% squared error. (Right column, p. 532) However Sloan fails to teach a 
computer readable data carrying media having encoded thereon computer-executable 
instructions for performing a computer graphics image rendering method, the method 
comprising calculating data of meso-scale radiance transfer finely sampled over a 
meso-structure texture patch mapped over a surface of the object. This is what 
Heidrich teaches. Heidrich teaches utilization of graphics hardware for an additional 
performance gain, assuming standard OpenGL like graphics pipeline with some 
extensions and to implement the pixel texture extension in software. (Right column, p. 
458) Furthermore, Heidrich teaches the scattering of light via two points p and q in the 
height field first requires us to compute the direct illumination in q. If we do this for all 
grid points we obtain a texture Ld containing the reflected light caused by the direct 
illumination in each point. This texture Ld is generated using the bump mapping 
mechanism the hardware provides. Referring to figure 5, the second texture Ld 
contains reflected direct light in each point, which acts as an incoming radiance at p. 
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(Left column, p.459) Although Sloan does not explicitly teach evaluating radiance 
transfer over at least a portion of the surface of the object from a lighting environment 
for a view direction based on a combination of macro-scale radiance transfer data and 
meso-scale radiance transfer data, it would have been obvious to one of ordinary skill in 
the art at the time the present invention was made to combine the teachings of 
calculating data of meso-scale radiance transfer sampled over a texture patched 
mapped over a surface as taught by Heidrich into calculating data of macro scale 
radiance transfer sampled over a surface taught by Sloan because the computation of 
meso-scale radiance transfer as taught by Heidrich allows for reduced scattering in the 
case where curved base geometry causes the valleys to widen up, and at the same 
time, more regions are shadowed (Lower left column of p. 462 and Fig, 11) and allows 
the use of geometry, bump nriaps, and BRDFs as different levels of detail for a surface 
structure (Right column of p. 462) and therefore a more accurate 3-D model would be 
realized. 

Regarding claim 10, Sloan teaches the computer-readable data carrying media 
wherein the global effects comprise of self-shadowing and interrelection by showing the 
resulting precomputed model allows run-time changes to lighting, with correct 
shadowing and interrelections in any low-frequency lighting environment (Left column of 
p. 533 and Fig. 6) Since claim 10 further limits claim 9 by providing the types of global 
effects utilized in macro-scale radiance transfer, the motivation and combination are 
incorporated by reference in the parent rejection. 
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Claims 3-8 and 1 1 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Sloan ("Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, 
Low-Frequency Lighting Environments") in view of Heidrich ("Illuminating Micro 
Geometry Based on Precomputed Visibility") in further view of Tong ("Synthesis of 
Bidirectional Texture Functions on Arbitrary Surfaces"). 

Consider claim 3, the teachings of Sloan and Heidrich are given in the previous 
paragraphs of this office action. However, both Sloan and Heidrich fail to teach a 
computer graphics image rendering method wherein calculating the meso-scale 
radiance transfer data comprises of producing a radiance transfer texture encoding 
response to incident lighting in a direction and at a location on the meso-structure 
texture patch and expressed as a lighting basis function and producing a spatial 
index map to map the locations on the meso-structure texture patch onto the surface of 
the object, via a precomputed texture synthesis. Nevertheless, this is what Tong 
teaches. Tong teaches real -world textures arise from both spatially variant surface 
reflectance and surface mesostructures, which are responsible fro fine-scale shadows, 
occlusions and specularities. (Left column of p. 665) Furthermore Tong teaches a 
possible way to achieve a consistent mesostructure on a surface is to directly apply 
surface texture synthesis techniques to surface BTF synthesis (Left column of p. 666) 
and the surface texton space S is the inner-product spanned by using the 3-D textons 
{t1 ....tn} as basis vectors. (Left column of p. 667) Although neither Sloan nor Heidrich 
explicitly teaches producing a radiance transfer texture expressed as a lighting basis 
function and producing spatial index map to map locations on the meso-structure patch 
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via texture synthesis, it would have been obvious to one of ordinary skill in the art at the 
time the present invention was made to combine the teachings of calculating data of 
macro-scale radiance transfer coarsely sampled over a surface as taught by Sloan, 
calculating data of meso-scale radiance transfer finely sampled over a meso-structure 
texture patch as taught by Heidrich and producing radiance transfer expressed as a 
lighting basis function and producing spatial index on the meso-structure texture patch 
via precomputed texture synthesis as taught by Tong in order to exhibit a consistent 
mesostructure when viewing and lighting directions change and to better describe real- 
world textures and enable the user to decorate real-world geometry with real-world 
textures (Left column of p.672) and accordingly, by incorporating the teachings of Tong 
with Sloan and Heidrich, a even more accurate 3-D model would be realized. 

Claim 4 is similar in scope to claim 3 and thus is rejected under similar rationale. 

Regarding claim 5, Sloan teaches the representation of radiance transfer of the 
object's surface sampled at macro-scale is a pre-computed radiance transfer matrix by 
showing both incident radiance and transfer functions in a linear basis, we exploit the 
linearity of light transport to reduce the light integral to a simple dot product between 
their coefficient vectors (diffuse receivers) or a simple linear transform of the lighting 
coefficient vector through a small transfer matrix for glossy receivers (Right column of p. 
527). Furthermore Sloan teaches if the object is glossy, a transfer matrix is applied to 
the lighting coefficients to produce the coefficient of a spherical function representing 
. self-scattered incident radiance at each point, (left column of p. 529). Since claim 5 
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further limits claim 4 by providing the representation of radiance transfer of the object's 
surface if the surface is glossy, the motivation and combination are incorporated by 
reference in the parent rejection. 

Regarding claim 6, Heidrich teaches the method wherein the representation of 
radiance transfer of a meso-structure of the object's surface sampled at meso-scale is a 
radiance transfer texture by showing the incoming radiance is not determined by the 
intensity of the light source, but rather by the content of the Ld texture. (Left column, p. 
458) Since claim 6 further limits claim 4 by providing the representation of meso-scale 
radiance transfer being texture, the motivation and combination are incorporated by 
reference in the parent rejection. 

Consider claim 7, Heidrich teaches the representation of radiance transfer of a 
meso-structure of the object's surface sampled at a meso-scale comprises a radiance 
transfer texture encoding response at a location on a meso-structure patch in a direction 
to incident lighting, and a spatial index map mapping from locations on a the surface of 
the modeled object to locations on the meso-structure patch, and wherein the spatial 
index map operates as an index to the radiance transfer texture by explaining incident 
illumination at any given surface point, and obtaining the reflected radiance for that point 
and a given viewing direction (right column of p. 457) and use of the hardware algorithm 
to compute higher dimensional data structures, such as light fields [8, 18] and both 
space variant and space invariant Bidirectional reflectance distribution functions, 
BRDFs. (Right column of p. 461) Since claim 7 further limits claim 4 by providing a 
means to map locations on the surface of the modeled object to locations on the meso- 
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scale patch, the motivation and combination are incorporated by reference in the parent 
rejection. 

Consider claim 8, Sloan teaches a function of radiance transfer texture 
comprising of a view direction to incident lighting by explaining the computing of transfer 
field over the objects surface in 3D rather than over a fixed 2D view to allow viewpoint 
changes. (Left column of p. 528) Sloan also teaches of a precomputed radiance 
transfer matrix encoding radiance response of the location on the surface of the 
modeled object to incident lighting L of the light environment by showing the matrix 
transforms the lighting coefficients into the coefficients of a spherical function 
representing transferred radiance (Fig. 2, p. 528 and equation 9, p. 530) However, 
Sloan fails to teach the function of radiance transfer encoding response indexed via an 
id map that mraps locations on the surface of the modeled object to locations on the 
meso-structure patch. This is what Tong teaches. Tong teaches from the surface 
texton map tout and the sample BTF T, we can efficiently render the BTF on the 
target mesh M as follows. First, we compute the viewing and lighting directions for 
each mesh vertex v in its local texture coordinate frame from the given light source 
location and the viewpoint. Vertices occluded from either the light sources or the 
viewpoint are ignored. Then, a set of nearby images are found from the BTF sample T. 
Using v*s texture coordinate, we can look up colors from this set of images and blend 
them to get the color of v. With all vertex colors obtained, the mesh can be sent to the 
graphics pipeline for display. This procedure repeats for every novel lighting/viewing 
configuration. (Left column of p. 670) Although Sloan does not explicitly teach the 
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function of radiance transfer texture indexed via an id map that maps locations on the 
surface of the modeled object to locations on the meso-structure patch, it would be 
obvious of one of ordinary skill in the art at the time of invention to calculate radiance 
transfer texture encoding response as taught by Sloan as a function of the mapping of 
locations on surface of modeled object to locations on the meso-structure patch as 
taught by Tong in order to efficiently render bidirectional texture function (BTF), which 
describes textures arising from both spatially variant surface reflectance and surface 
mesostructures (Abstract, p. 665) and exhibits a consistent mesostructure when viewing 
and lighting directions change (Left column of p. 672), and thus a more accurate 3-D 
model would be realized. 

Claim 1 1 is similar in scope to claim 3 except for the addition of a display driver 
operating to present the image of the modeled object in the lighting environment, which 
is taught by Heidrich. Heidrich teaches a framebuffer which is read out to main 
memory, and each pixel is replaced by a value looked up from a texture, using previous 
contents of the pixel as texture coordinates. (Right column of p. 458) Thus, claim 1 1 is 
rejected under similar rationale as claim 3. 



Conclusion 

Any inquiry concerning this communication or earlier communications from examiner 
should be directed to Kevin K Xu whose telephone number is 571-272-7747. The 
examiner can normally be reached on Monday-Friday from 8:30 AM - 5:00 PM. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Matthew Bella can be reached on (571) 272-7778. 

Information regarding the status of an application may be obtained from Patent 
Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.qov . Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EB) at 866-217-9197 (toll-free). 
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